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Abstract -In macroscopic systems, velocity-dependent phenomenological forces F{v) are used 
to model friction, feedback devices or self-propulsion. Such forces usually include a dissipative 
component which conceals the fast energy exchanges with a thermostat at the environment tem¬ 
perature T, ruled by a microscopic Hamiltonian H. The mapping {H, T) —>■ F{v) - even if effective 
for many purposes - may lead to applications of stochastic thermodynamics where an incomplete 
fluctuating entropy production (FEP) is derived. An enlighting example is offered by recent 
macroscopic experiments where dissipation is dominated by solid-on-solid friction, typically mod¬ 
elled through a deterministic Coulomb force F{v). Through an adaptation of the microscopic 
Prandtl-Tomlinson model for friction, we show how the FEP is dominated by the heat released 
to the T-thermostat, ignored by the macroscopic Coulomb model. This problem, which haunts 
several studies in the literature, cannot be cured by weighing the time-reversed trajectories with 
a different auxiliary dynamics: it is only solved by a more accurate stochastic modelling of the 
thermostat underlying dissipation. 


Introduction. — Since its infancy, non-equilibrium 
statistical mechanics has been based on models with 
,—1 coarse-grained forces mm- Indeed the origin of ther- 
o\ mostats and non-conservative forces is a reduction of the 
description from a larger Hamiltonian system, where many 
degrees of freedom have been projected out [3]. 
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Dissipation is an essential ingredient in non-equilibrium 
systems [3], consisting in a net - or average - transfer 
of energy from the degrees of freedom we are observing 
(i.e. the system), to a large and often hidden reservoir - 
the environment - which has a lower energy density. For 
large macroscopic systems the transfers of energy in the 
opposite direction are very unlikely [5]. Mesoscopic sys¬ 
tems, where such fluctuations are non-negligible, are the 
subject of stochastic thermodynamics (ST) whose study 
has received a great impulse in the last 20 years laiz]. 
A central issue in ST is relating fluctuations of currents, 
such as energy flows, to the fluctuating entropy production 


(FEP) 0. 

A major contribution of the present Letter is to provide 
a neat example where such dissipation-FEP connection is 
dramatically broken when the macroscopic model ignores 
the microscopic fluctuations. We take into detailed con¬ 


sideration the force acting between two sliding solid bod¬ 
ies, that is the so-called dry friction, which in macroscopic 
systems (e.g. on scales larger than few millimeters) is well 
described by the law of Coulomb friction mn]. In our 
analysis it becomes clear that the Coulomb model is too 
much coarse-grained and, for this reason, it neglects the 
dominant contribution to the PEP [ima. The proper 
thermodynamics is restored by taking into account the 
underlying thermostat. 

Apparently, this problem has been overlooked in the 
recent literature. Por instance, entropy production of 
Coulomb friction is usually neglected in Langevin mod¬ 
els [14]. In [T5l[T6] a Langevin equation with feedback 
is considered, generalizing a model for atomic manipula¬ 
tion of macromolecules m When velocity-dependent, 
the feedback mechanism in these models dissipates en¬ 
ergy: in it is explicitly recognised that it acts as 
a refrigerator. However the application of stochastic 
thermodynamics, even with the help of artificial “conju¬ 
gate” time-reversed dynamics, leads to a formula for PEP 
which does not take into account the heat flowing to the 
low-temperature thermostat. Similar problems affect a 
macroscopic velocity-dependent force m which accounts 
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Fig. 1: A: sketch of the generic model we discuss in the sec¬ 
tion “Levels of coarse-graining and dissipation”, Eqs. o 
and 0. B: sketch of the PT model discussed in the section 
“The Prandtl-Tomlinson Model”, Eq. (fTOll . 


for both friction and self-propulsion in an active matter 
model m- In all these cases the error does not reside in 
the recipe of stochastic thermodynamics, but rather in the 
incomplete modelling of dissipation. 

Levels of coarse-graining and dissipation. In 

the present paper we consider two levels of coarse-graining: 
Cl and C2. The first level. Cl, is the widely adopted 
reduction of a large Hamiltonian system into a sub-system 
(the part of interest) plus a thermostat that obeys a much 
simpler dynamics [3]. The second coarser level C2 is useful 
to describe macroscopic systems, when the perturbation 
acts on scales much larger than the microscopic ones. 

Eigure[TJ\ depicts a general scheme to discuss Cl. A 
Hamiltonian system is composed of two interacting sub¬ 
systems S and 0: a point in the complete phase (“zero 
level”) space is Pq = (PsiPe)- In the limit where 0 is 
much larger than E, one can consider 0 as a “thermostat”, 
since its energy is barely affected by its interaction with E. 
If need be, an external perturbation is applied to some of 
the degrees of freedom of E: the nature and formal details 
of the perturbation are discussed later. We consider a 
probabilistic description where the phase space position 
To is distributed with some probability density Po{TQ,t) 
at time t. This density obeys an equation of the kind 


= [Ao(ro) + Le.t(rE,t)]Po(ro,t), (i) 

where Lq is the Liouville operator associated to the to¬ 
tal Hamiltonian Hq{To) and L^xt represents the external 
perturbation, which can be deterministic, stochastic, time- 
dependent or not, etc. The first level of coarse-graining. 
Cl, consists in focusing on Ti = Fs alone, by replacing 
Eq. ([T]) with the following [5]: 


= [Li(ri) + Le.t(ri,t)]Pi(ri,t), (2a) 

Li(Fi) = Lff(Fi) + LT(ri). (2b) 

In Eq. (m , the Lh operator is the Liouville operator as¬ 
sociated to the Hamiltonian iL(Fi) of the system E alone, 


i.e. the internal dynamics of the system of interest and Lt 
is the operator describing - in some simplified form - its 
coupling to 0. A common and convenient choice for Lt is 
a stochastic operator: for instance, if memory effects can 
be neglected, Lt takes the form of a Markovian master 
equation operator. Its transition rates, in order to reflect 
the invariance of Lq under time-reversal, must satisfy de¬ 
tailed balance with respect to the Gibbs measure defined 
by Hamiltonian H and temperature T. 

A tool which has been widely used for a formal char¬ 
acterization of time-reversal invariance (or variance), at 
the level of single trajectories, is the so-called action func¬ 
tional [5]: 


Wi{t) = In 


p({r.(s)}Mr.(o)) 

p({er,(t-s)}*|er,(t))’ 


(3) 


where i can be 0 or 1 depending on the level of de¬ 
scription. The numerator in ([3]) represents the probabil¬ 
ity, conditioned to the state at time 0, of a trajectory 
ri(s) with s G (0,t). The denominator is the probability, 
conditioned to the time-reversed final state, of the time- 
reversed trajectory: e is a diagonal operator which leaves 
unchanged all positions and changes sign to all velocities. 
It is meant, of course, that the conditional probability 
for the trajectory at level i = 0 (i = I) is generated by 
Eq. (P) (Eq. (P). When Lext = 0 one has Wo{t) = 0 and 
Wi{t) = (detailed balance). The cases 

where both L^xt and Lt are deterministic are usually dis¬ 
cussed in the context of phase-space contraction . Sev¬ 
eral physical examples have been given in the literaturcJil 
where the action functional takes the form Wext{t)/kBT, 
with Wext (t) the work done by the non-conservative forces 
during the trajectory. Another situation commonly dis¬ 
cussed is when Lext represents the interactions with a sec¬ 
ond bath at a temperature T' ^ T: in that case the action 
functional takes the form Q{t) | y — ^ |, with Q{t) the en¬ 
ergy transferred from the external thermostats into the 
system during the trajectory. Both examples suggest a 
strong analogy between the action functional and thermo¬ 
dynamic entropy production, where the energy flowing to 
the thermostat, i.e. the dissipation, enters explicitly. In 
stochastic thermodynamics the formulation we choose in 
Eq. dS]) is referred to as EEP of the medium [6] . 

When the external perturbation Lext acts on space-time 
scales much larger than those dictated by Lh and Lt, it 
is convenient and common to scale up the description to a 
“macroscopic” level, what we call the C2 coarse-graining. 
This operation is usually achieved by phenomenological 
considerations, cases where it can be rigorously carried 
on being rare. Only those degrees of freedom which are 
relevant at large scales, F 2 , are retained and the evolution 

^The reader is warned that we do not intend to exhaust in a 
few sentences the huge field of FEP, our aim is to summarize a few 
basic observations. Those are made rigorous under more precise hy¬ 
potheses, and, possibly, with the addition of the so-called “boundary 
terms” [2ll[22] 
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of their probability takes the form 

= [L2 (r2) + (r2, t)] P 2 (r2, t). (4) 

The L 2 operator represents the contraction of microscopic 
Hamiltonian {Lh) and thermostat (Tt) parts, and it is 
often non-conservative and deterministic. Indeed, the aim 
of C2 is to get a fair description of the trajectories at a 
macroscopic resolution where energy is dissipated and fluc¬ 
tuations are usually negligible. The result is that L 2 fairly 
accounts for dissipation, but may violate detailed balance, 
a required symmetry in the absence of L^xt- In addition, in 
view of the huge difference of energy scales, the probability 
that the time-reversal of a typical trajectory is observed 
is exceedingly small: for this reason, in many common 
cases |miT6M l8].L2 does not describe properly those tra¬ 
jectories and strongly twists W{t). Generalisations W{t) 
of the action functional W(t) have been proposed (see for 
instance [HHM]) where the probability weighing the re¬ 
versed trajectory, i.e. that appearing at the denominator 
of Eq. dSl), is replaced by a different probability, generated 
by an auxiliary dynamics. Unfortunately this ad hoc pre¬ 
scription changes the physical meaning (and the accessi¬ 
bility in experiments) of the action functional and usually 
does not solve the discrepancy. The only way to get an 
action functional which properly represents the thermody¬ 
namics of the system is to include, in L 2 , the fluctuations 
which are conjugate to the modelled dissipation restoring 
the condition of detailed balance in absence of L^xt |25) . 
In the next Sections we discuss in details a clear example 
to understand this scenario. 

The case of Coulomb friction. — A particularly 
interesting macroscopic dissipative force (i.e. of the kind 
of L 2 ) is the so-called dry or solid-on-solid friction: it de¬ 
scribes the force against relative sliding between two solid 
surfaces at contact m- In its simplest and oldest form, 
which is considered a fair approximation at the C2 level 
of coarse-graining, it reads 

Fc{V) = -Aa(U), (5) 

where A = /xEjv is a positive force proportional, through 
the (dynamical) friction coefficient /r to the normal force 
Fat, and a{v) is -fl,—1,0 if ?; > 0, < 0 or r; = 0 respec¬ 

tively. When the body is at rest also the static friction 
force should be considered: however its role is marginal in 
this context because the external driving typically gives 
strong impulsive forces to the sliding mass. 

In the last decades the study of solid friction, taking 
also advantage of experimental techniques at the micro 
and nano scales, has refined dramatically the simple law 
in Eq. ([5]) [11]. It is known that it should be modified 
to take into account thermal effects, aging of contacts, 
dependence upon V, and much more. Notwithstanding 
those progresses, Eq. ([5|) remains useful in simple macro¬ 
scopic situations. An example where it fairly describes 
experimental results is in laiiziisH]: a solid macroscopic 


rotator is in contact with a fluidized granular gas made 
of spherical beads of mass Mg and granular temperature 
Tg (see Eq. ([7|) below for an operative definition). The 
beads hit the solid body and excite its rotation, which is 
then damped by solid friction in the ball bearings allowing 
rotation. In the following we also use the name “tracer” 
to indicate the rotator, and we use X and V to mean its 
(angular) position and velocity respectively. When the 
granular gas is dilute the collision are described by a non- 
continuous Markov process with transition rates dictated 
by the collisional kinetics IMIlSDj. The master-equation for 
P{X,V,t) then is equivalent to Eq. (|1|) with r 2 = {X,V) 
and 


L2- = —dx\V-] — dv 


FciV) 


M 


LextPiX,V,t) = j dUP{X,U,t)k{U ^V) 
- j dUP{X,V,t)k{V ^ U). 


(6a) 

(6b) 


A simplified form of the transition rates, used in some 
theoretical studies |3T] and convenient for its simplicity, is 
the following 


k{V ^V')=T 


_i f Mg + M \ 

2 a /Mg j yJ^2'ITkBTg 


(7) 


where Tg is the “temperature” of the granular gas and 

n{V, V') = {V -V) + V. (8) 


In the above transition rates we have not considered the 
inelasticity of collisions, which is indeed negligible with re¬ 
spect to the dissipation due to Fc{V) when collisions are 
not too frequent (“rare collision limit”, discussed in [29]). 
To give an idea of the energy, space and time scales, it 
should be considered that in the experiments the mass of 
the rotator is ^ 5 g, the diameter of the beads is ~ 4 mm 
and their mass is ^ 10“^ g, while their average speed is 
^ 10^ mm/s, that is an average kinetic energy of the or¬ 
der of ^ 10“® J, leading to a Tg of the order of ~ 10^^ K. 
Other experiments have been performed where Coulomb 
force Fc{V) is coupled to time-dependent external pertur¬ 
bations [5MM] . Those experiments have also triggered 
the interest of many theoreticians who studied the prob¬ 
lem with different kinds of noise [35H37] . 

One of the less studied aspects of Eq. is its behav¬ 
ior under time-reversal. There is an evident obstacle in 
doing that: if a trajectory {U(s)}q between times 0 and 
t solves Eq. ([5]) with a given noise realization, there is no 
way (by means of any other noise realization) that the 
time-reversed trajectory {—V{t — s)}q satisfies the same 
equation. Indeed all the parts of the dynamics where only 
friction is acting (decreasing |U|) are mapped, by time- 
reversal, to trajectories taking energy (increasing |U|), 
which are forbidden by Fc{V). A consequence of this 
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observation is that the action functional Eq. m cannot 
be properly defined. Nonetheless, we can always empiri¬ 
cally define the FEP of a system coupled to several reser¬ 
voirs as the sum of the energies that the system exchanges 
with each thermostat, divided by the temperature of the 
thermostat. Since our system seems coupled to a single 
thermostat (i.e. the grains) this definition leads to 


Wit) 


* c 

E 


2=1 


SE, 

ksTg' 


(9) 


where Nc is the total number of collisions occurring in the 
interval [0,t] and SEi = — E/) the energy gained 

in the f-th collision. Another possibility is to choose Wit) 
by modifying the action functional ([3]); the probability of 
the time-reversed trajectories is generated with an auxil¬ 
iary dynamics obtained by inverting the sign in front of 
the Coulomb force With this prescription the 

generalized action functional takes the exact form of Eq. 
Q (see the analogous calculation in the next Section). 

When Mg M, it is possible [38] to approximate Eq. 
(I6b|) with Lext ■ = M~'^dv['lgV ■] + M~^jgTgdy[ • ]: in 
such a limit [ssmo] the paradox vanishes, because noise 
acts continuously and some noise realization that sustains 
the reversed trajectory can always be found (with differ¬ 
ent probability, of course). On the other hand, the limit 
is singular in the sense that Eq. (|6|) with white noise is 
a potential equation and satisfies detailed balance: the 
stationary state is an equilibrium state in which the ac¬ 
tion functional has zero average and the physical meaning 
of dissipation is totally lost M- Nevertheless, the gen¬ 
eralized action functional obtained with the above “cor¬ 
rected” sign prescription takes the form, up to boundary 
terms. Wit) = —A dt'\Vit')\/Tg, i.e. minus the work 
done by the friction force divided by the temperature of 
the thermostat. Since in the stationary state this work is 
on average equal to the energy exchanged with the ther¬ 
mostat, this quantity is in agreement with our intuitive 
definition of entropy and with Eq. Despite the ap¬ 
parent coherence of the above proposed solutions we will 
show, in the next Section, that the results are incomplete, 
mainly because the coarse graining is hiding the thermo¬ 
stat responsible for the largest part of the FEP. It should 
be noticed that measures of the fluctuations of these and 
other physical currents (e.g. angle spanned by the rotator 
in a time t) have been performed, finding interesting large 
deviations properties m- In order to understand the con¬ 
nection between measured macroscopic currents and the 
appropriate FEP, in the next Section we will resort to a 
more fundamental model (Cl level). 

The Prandtl-Tomlinson Model. — A good candi¬ 
date reveals to be the so-called Prandtl-Tomlinson (PT) 
model, which is often considered as a prototype of micro¬ 
scopic mechanism for friction [35]. In the last decades it 
has been used in theoretical studies to interpret results 
from Friction Force Microscopy experiments. In PT equa¬ 


tions the frictional force EciV) acting on the tracer is 
replaced by a harmonic force Apr = — k(A — a;) linking it 
to a virtual “effective” particle of mass m (whose position 
and velocity are denoted by x, v respectively) which moves 
on a corrugated surface and is in contact with the environ¬ 
mental thermostat, see Fig. [33. In our case the probability 
P(A, P, cc, p, t) obeys Eq. ([2|) with Pi = iX,V,x,v) and 


H = 


Ap* = 




(-) 


mv 


ix-xY^ 


Uq cos 


/ 2Trx 


djv) 

dv 


( lkBT \ ^ 
\ / dv^ 


(10a) 

(10b) 


and Lext is the same appearing in Eq. ®, i.e. acting only 
on V through “granular” collisions. Note that here for the 
thermostat we use a Ornstein-Uhlenbeck force of the kind 
— 7 ti -I- i/ 27 T^(t), with ^(t) a Gaussian white noise. 

The PT force is usually studied in a different con¬ 
text where the first mass moves at constant velocity, i.e. 
A(t) = XiO) + vot, reproducing experiments with uniform 
sliding m- In that case, provided that ksT <C kA^/2 < 
2tt^Uo, the stationary state is a quasi-periodic stick slip 
motion where, in a range of velocity vq ^ -^/Uo/M, the 
average friction force (Epr) has a negligible (logarithmic 
or smaller) dependence upon vq. In our model (IIOI) the 
velocity of the first mass is not constant but feels the 
slowing effect of Fpp and, at random times, is instanta¬ 
neously changed with probability rates given by Eq. o, 
i.e. with a typical after-collision value of the order of 
Vg = y^kpTg/M. In the model, therefore, it makes sense 
to choose Vg » ytJJo/M, that is kpTg Uq- When giving 
the parameters of simulations, we take as unit of mass M, 
unit of time r and unit of length A = y^ksTg/Mr (that 
is unit of energy kpTg). In Figure |2] we compare the tra¬ 
jectories from a simulation of the macroscopic model (jH]) 
and a simulation of the microscopic one dloj. The figure 
fairly demonstrates that the trajectories look quite similar 
if small details (as in the inset) are ignored. 

Set the model, we now turn our attention to the FEP. 
The action functional Eq. ([3|) can be split in two contri¬ 
butions due, respectively, to the collisional and diffusional 
part of the dynamics Wit) = Wcoii + Wdiff- Given that 
in the time interval [0,t] the tracer receives collisions, 
we have 


Nc 

Wcou = y^ln 
2 = 1 


kiV^ ^ VI) 
ki-Vl ^ -P) 


c 

E 


2=1 


6E, 

kpTg 


( 11 ) 


with SEi = — VY) the energy gain in the i-th col¬ 

lision. The term due to diffusion reads 


Nc 


Wd^ff = J2{- dsAiWis))+ 



ds AieTiiti 
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Fig. 2: Comparison of trajectories from a simulation of 
the Coulomb model (above) and PT model (below). Adi- 
mensionalised parameters are: Mg/M = 0.8 (in both 
models), m/M = 10“^, yr/M = 10“^, T/Tg = 10“®, 
Uo/{kBTg) = 1.6 • 10-^ nX^iksTg) = 10, L/X = lO'^, 
which gives kL'^= 1.6- 10“^. As macroscopic 
Coulomb force we have used At^/(MA) = 0.05 ^ {Fpx)- 


where 


A{X, V, X, v) = 


A'yksT 

With some algebra one gets 


dH 

mv -f yr; -I- 

ax 




Wdiff = 


1 


keT 


E 


AK, + AU, - 


ds k{x — X)V 


where AKi and AUi are the changes of AT = mv^/2 and 
U = Uo cos{2ttx / L) + k{X — xy/2, respectively, in the 
interval [A_i,A]. Let us note that, as expected for the 
unperturbed dynamics, the contribution to Wdiff 

of a single flight between two collisions at times U-i and 
ti satisfies detailed balance, i.e. 

SH, def H[W{U_,)]-H[T,{U)] 

- ~k^ - fc^T ■ 

A crucial comment is in order concerning the magnitude 
of the two contributions to FEP. In the steady state the 
energies 5Ei exchanged in the collisions balance, on av¬ 
erage, the energies exchanged with the thermostat, i.e. 
{5Ei) = —{SHi) > 0, however Tg ^ T and therefore 
\{Wdiff)\ A> \(yVcou)\- In addition the probability of ob¬ 
serving negative values of W (see inset of Fig. [3]) is ex¬ 
ceedingly small. In conclusion, the macroscopic descrip¬ 
tion given by the Coulomb model completely misses a huge 
contribution to the FEP due to the coupling with the en¬ 
vironmental thermostat at the temperature T. 

The cure of this problem can only come by a correct 
modelling of the stochastic part of the thermostat, which 
is ignored in Fc of Eq. ®, while it is included in Fpx of 
Eq. (ITTIl) . Model dTUl) is de facto a solution of the problem. 


Fig. 3: Comparison of probability distribution functions 
of Wcoii integrated of a time-window of length I5r, from 
a simulation of the PT model (blue data), and of the 
Coulomb model (red data). Inset: probability distribution 
function of the action functional W in the PT model. Adi- 
mensionalised parameters are Mg/M = 0.8, m/M = 10“^, 
yr/A/ = 10-3, T/Tg = 2 ■ lO'^, Uo/ikpTg) = 3.18 • 
lO”"^, kX'^/( kpTg) = 0.1, L/X = 1.4 • 10“"^, which gives 
kL"^/(Att'^Uq) = 1.6 • 10“"^. For the macroscopic Coulomb 
model we used At'^/{MX) = 0.0071 ~ (Fpt)- 


as it correctly reproduces both dissipation and fluctua¬ 
tions due to sliding friction. Its simulation, however, may 
require quite an intense computational power if compared 
with Eq. ®. A procedure to complement Eq. m with 
the appropriate stochastic process reproducing the hidden 
thermostat is indicated in [25) : the explicit form of the 
noise, however, is not necessary to retrieve the expression 
for the entropy production. Indeed, if in the absence of 
external perturbations the dynamics satisfies detailed bal¬ 
ance, is - by definition - the difference in kinetic 

energy divided by T (in analogy with Eq. (US)- 

Leaving aside the problem of entropy production, it is 
still interesting to observe the fluctuations of Wcoii which 
in principle can be studied in experiments. These are, 
apart from the constant \/{kBTg) factor, the fluctuations 
of the energy flux going from the granular gas into the 
tracer. In Figure |3] we show the very good agreement of 
the distribution of these fluctuations in simulated steady 
states of the two models. Obtaining general relations for 
the fluctuations of WcoU remains an open problem: a start¬ 
ing point is offered by the known relations for the joint 
probability distribution of currents m- 

Conclusion. — In this Letter we have considered the 
effect of coarse-graining which is operated when dealing 
with out-of-equilibrium macroscopic systems, where the 
interaction with environmental thermostats is replaced by 
effective (often phenomenological) dissipative forces. We 
have shown how the effect of coarse-graining drastically 
changes the properties of the model under time-reversal 
if fluctuations are not properly described. In the case 
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of Coulomb friction, the friction force originates from a 
configurational potential but is modelled as a velocity- 
dependent force, changing its time-reversal parity. More¬ 
over, if the Coulomb law is introduced without its conju¬ 
gate fluctuations, the dominant part of the FEP is lost. 

The general idea, as always, is that coarse-graining is 
a loss of variables, or information. Such information is 
relevant or not, depending on the question one consid¬ 
ers [121113] . Microscopic variables are not really relevant 
for many observables: for instance, in the above example, 
the correct fluctuations of WcoU are perfectly recovered 
even in the coarse-grained model. Other properties, which 
require a finer knowledge of the system, are lost. 

A similar situation has been encountered, in the past, 
with inelastic collisions: the collisional dissipation is mod¬ 
elled as an instantaneous loss of energy without thermal 
fluctuations [Hj. The real FEP, therefore, cannot be ac¬ 
counted for by the measurement of the dissipated macro¬ 
scopic energy in collisions. The dominant channel for en¬ 
tropy production is the transfer of such energy to the en¬ 
vironment, whose fluctuations are quite difficult to be ob¬ 
served. This situation sometimes may be counterintuitive, 
since the energy flux transferred to the environment is on 
average the same as that dissipated macroscopically. How¬ 
ever the thermostats involved are totally different. 

* * * 

The authors acknowledge fruitful discussions with A. 
Sarracino, G. Jona-Lasinio and A. Vulpiani. 
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